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(57) Abstract 



A method for recommending items to users using automated collaborative 
filtering stores profiles of users relating ratings to items in memory. Profiles of 
items may also be stored in memory, the item profiles associating users with the 
rating given to the item by that user or inferred for the user by the system. The 
user profiles include additional information relating to the user or associated with 
the rating given to an item by the user. Similarity factors with respect to other 
users, and confidence factors associated with the similarity factors, are calculated 
for a user and these similarity factors, in connection with the confidence factors, 
are used to select a set of neighboring users. The neighboring users are weighted 
based on their respective similarity factors, and a rating for an item contained in 
the domain is predicted. In one embodiment, items in the domain have features. In 
this embodiment, the values for features can be clustered, and the similarity factors 
incorporate assigned feature weights and feature value cluster weights. 
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IMPROVED METHOD AND APPARATUS 
FOR ITEM RECOMMENDATION USING 
AUTOMATED COLLABORATIVE FILTERING 

This application is a continuation-in-part application of co-pending application Serial No. 
08/597,442 filed February 2, 1996, which itself claims priority to provisional application Serial 
No. 60/000,598, filed June 30, 1995, now expired, and co-pending provisional application 
60/008,458, filed December 11, 1995, now expired, all of which are incorporated herein by 
5 reference. 

Field of the Invention 

The present invention relates to an improved method and apparatus for recommending 
items and, in particular, to an improved method and apparatus for recommending items using 
automated collaborative filtering and feature-guided automated collaborative filtering. 

10 Background of the Invention 

The amount of information, as well as the number of goods and services, available to 
individuals is increasing exponentially. This increase in items and information is occurring across 
all domains, e.g. sound recordings, restaurants, movies, World Wide Web pages, clothing stores, 
etc. An individual attempting to find useful information, or to decide between competing goods 

15 and services, is often faced with a bewildering selection of sources and choices. 

Individual sampling of all items, even in a particular domain, may be impossible. For 
example, sampling every restaurant of a particular type in New York City would tax even the 
most avid diner. Such a sampling would most likely be prohibitively expensive to carry out, and 
the diner would have to suffer through many unenjoyable restaurants. 

20 In many domains, individuals have simply learned to manage information overload by 

relying on a form of generic referral system. For example, in the domain of movie and sound 
recordings, many individuals rely on reviews written by paid reviewers. These reviews, however, 
are simply the viewpoint of one or two individuals and may not have a likelihood of correlating 
with how the individual will actually perceive the movie or sound recording. Many individuals 

25 may rely on a review only to be disappointed when they actually sample the item. 
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One method of attempting to provide an efficient filtering mechanism is to use content- 
based filtering. The content-based filter selects items from a domain for the user to sample based 
upon correlations between the content of the item and the user's preferences. Content-based 
filtering schemes suffer from the drawback that the items to be selected must be in some machine- 
5 readable form, or attributes describing the content of the item must be entered by hand. This 
makes content-based filtering problematic for existing items such as sound recordings, 
photographs, art, video, and any other physical item that is not inherently machine-readable. 
While item attributes can be assigned by hand in order to allow a content-based search, for many 
domains of items such assignment is not practical. For example, it could take decades to enter 
10 even the most rudimentary attributes for all available network television video clips by hand. 

Perhaps more importantly, even the best content-based filtering schemes cannot provide 
an analysis of the quality of a particular item as it would be perceived by a particular user, since 
quality is inherently subjective. So, while a content-based filtering scheme may select a number of 
items based on the content of those items, a content-based filtering scheme generally cannot 
15 further refine the list of selected items to recommend items that the individual will enjoy. 

Summary of the Invention 
The present invention relates to an improved method and apparatus for recommending 
items to users of a system which uses automated collaborative filtering to accurately predict the 
rating that a user will give to an item based on the rating given to that item by users that have 
20 tastes closely correlated with that user. 

In one aspect, the invention relates to a method for recommending an item to a user. A 
user profile is stored in memory for a number of users, and the user profiles store the ratings given 
to items by a particular user, as well as additional information. The additional information may be 
information about the user or it may be information regarding the ratings given to an item by that 
25 user. Item profiles also may be stored in memory and the item profiles store ratings given to that 
item by a number of users. 

The information stored in the user profiles is used to calculate a set of similarity factors 
which indicate the amount of correlation between a user and other users of the system. A 
plurality of users that are closely correlated to a particular user are selected as that user's 
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neighboring users and a weight is assigned to each of them. The ratings given to items by the 
neighboring users as well as the weights assigned to those neighboring users are then used to 
predict ratings and to make recommendations of items that the user has not yet rated. 

In another aspect, the invention relates to an apparatus for recommending items which 
5 include a memory element for storing user profiles, each user profile including rating at least 

rating information. The apparatus also includes a means for calculating similarity factors between 
users, a means for selecting neighboring users, and a means for assigning a weight to those 
neighboring users. Also included is a means for recommending one of the items to one of the 
users based on that user's neighboring users and the weights assigned to that user's neighboring 
10 users. 

In yet another aspect, the invention relates to an article of manufacture having embodied 
thereon computer-readable program means for storing user profiles in a memory. The article of 
manufacture includes computer-readable program means for storing user profiles in a memory 
element, and each user profile includes at least rating information. The article of manufacture also 
15 includes computer-readable program means for calculating similarity factors between users, 
computer-readable program means for selecting neighboring users, and computer-readable 
program means for assigning a weight to those neighboring users. Also included is 
computer-readable program means for recommending one of the items to one of the users based 
on that user's neighboring users and the weights assigned to that user's neighboring users. 

20 Brief Description of the Drawings 

This invention is pointed out with particularity in the appended claims. The above and 
further advantages of this invention may be better understood by referring to the following 
description taken in conjunction with the accompanying drawings, in which: 
FIG. 1 is a flowchart of one embodiment of the method; 
25 FIG. 2 is a flowchart of another embodiment of the method; 

FIG. 3 is a block diagram of an embodiment of the apparatus; and 
FIG. 4 is a block diagram of an Internet system on which the method and apparatus may 
be used. 



Detailed Description of the Invention 
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As referred to in this description, items to be recommended can be items of any type that a 
user may sample in a domain. When reference is made to a "domain," it is intended to refer to 
any category or subcategory of ratable items, such as sound recordings, movies, restaurants, 
vacation destinations, novels, or World Wide Web pages. Referring now to FIG. 1, a method for 
recommending items begins by storing user and item information in profiles. 

A plurality of user profiles is stored in a memory element (step 102). One profile may be 
created for each user or multiple profiles may be created for a user to represent that user over 
multiple domains. Alternatively, a user may be represented in one domain by multiple profiles 
where each profile represents the proclivities of a user in a given set of circumstances. For 
example, a user that avoids seafood restaurants on Fridays, but not on other days of the week, 
could have one profile representing the user's restaurant preferences from Saturday through 
Thursday, and a second profile representing the user's restaurant preferences on Fridays. In some 
embodiments, a user profile represents more than one user. For example, a profile may be created 
which represents a woman and her husband for the purpose of selecting movies. Using this 
profile allows a movie recommendation to be given which takes into account the movie tastes of 
both individuals. For convenience, the remainder of this specification will use the term "user" to 
refer to single users of the system, as well as "composite users." The memory element can be any 
memory element known in the art that is capable of storing user profile data and allowing the user 
profiles to be updated, such as disc drive or random access memory. 

Each user profile associates items with the ratings given to those items by the user. Each 
user profile may also store information in addition to the user's rating. In one embodiment, the 
user profile stores information about the user, e.g. name, address, or age. In another 
embodiment, the user profile stores information about the rating, such as the time and date the 
user entered the rating for the item. User profiles can be any data construct that facilitates these 
associations, such as an array, although it is preferred to provide user profiles as sparse vectors of 
n-tuples. Each n-tuple contains at least an identifier representing the rated item and an identifier 
representing the rating that the user gave to the item, and may include any number of additional 
pieces of information regarding the item, the rating, or both. Some of the additional pieces of 
information stored in a user profile may be calculated based on other information in the profile, 
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for example, an average rating for a particular selection of items (e.g., heavy metal albums) may 
be calculated and stored in the user's profile. In some embodiments, the profiles are provided as 
ordered n-tuples. 

A profile for a user can be created and stored in a memory element when that user first 
5 begins rating items, although in multi-domain applications user profiles may be created for 

particular domains only when the user begins to explore, and rate items within, those domains. 

Alternatively, a user profile may be created for a user before the user rates any items in a domain. 

For example, a default user profile may be created for a domain which the user has not yet begun 

to explore based on the ratings the user has given to items in a domain that the user has already 
10 explored. 

Whenever a user profile is created, a number of initial ratings for items may be solicited 
from the user. This can be done by providing the user with a particular set of items to rate 
corresponding to a particular group of items. Groups are genres of items and are discussed below 
in more detail. Other methods of soliciting ratings from the user may include: manual entry of 

15 item-rating pairs, in which the user simply submits a list of items and ratings assigned to those 
items; soliciting ratings by date of entry into the system, i.e., asking the user to rate the newest 
items added to the system; soliciting ratings for the items having the most ratings; or by allowing a 
user to rate items similar to an initial item selected by the user. In still other embodiments, the 
system may acquire a number of ratings by monitoring the user's environment. For example, the 

20 system may assume that Web sites for which the user has created "bookmarks" are liked by that 
user and may use those sites as initial entries in the user's profile. One embodiment uses all of the 
methods described above and allows the user to select the particular method they wish to employ. 

Ratings for items which are received from users can be of any form that allows users to 
record subjective impressions of items based on their experience of the item. For example, items 
25 may be rated on an alphabetic scale ("A" to "F") or a numerical scale (1 to 10). In one 

embodiment, ratings are integers between 1 (lowest) and 7 (highest). Ratings can be received as 
input to a stand-alone machine, for example, a user may type rating information on a keyboard or 
a user may enter such information via a touch screen. Ratings may also be received as input to a 
system via electronic mail, by telephone, or as input to a system via a local area or wide area 
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network. In one embodiment, ratings are received as input to a World Wide Web page. In this 
embodiment, the user positions a cursor on a World Wide Web page with an input device such as 
a mouse or trackball. Once the cursor is properly positioned, the user indicates a rating by using a 
button on the input device to select a rating to enter. Ratings can be received from users 
singularly or in batches, and may be received from any number of users simultaneously. 

Ratings can be inferred by the system from the user's usage pattern. For example, the 
system may monitor how long the user views a particular Web page and store in that user's 
profile an indication that the user likes the page, assuming that the longer the user views the page, 
the more the user likes the page. Alternatively, a system may monitor the user's actions to 
determine a rating of a particular item for the user. For example, the system may infer that a user 
likes an item which the user mails to many people and enter in the user's profile and indication 
that the user likes that item. More than one aspect of user behavior may be monitored in order to 
infer ratings for that user, and in some embodiments, the system may have a higher confidence 
factor for a rating which it inferred by monitoring multiple aspects of user behavior. Confidence 
factors are discussed in more detail below. 

Profiles for each item that has been rated by at least one user may also be stored in 
memory. Each item profile records how particular users have rated this particular item. Any data 
construct that associates ratings given to the item with the user assigning the rating can be used. 
It is preferred is to provide item profiles as a sparse vector of n-tuples. Each n-tuple contains at 
least an identifier representing a particular user and an identifier representing the rating that user 
gave to the item, and it may contain other information, as described above in connection with user 
profiles. Item profiles may be created when the first rating is given to an item or when the item is 
first entered into the system. Alternatively, item profiles may be generated from the user profiles 
stored in memory, by determining, for each user, if that user has rated the item and, if so, storing 
the rating and user information in the item's profile. Item profiles may be stored before user 
profiles are stored, after user profiles are stored, or at the same time as user profiles. 

The additional information associated with each item-rating pair can be used by the system 
for a variety of purposes, such as assessing the validity of the rating data. For example, if the 
system records the time and date the rating was entered, or inferred from the user's environment, 



WO 98/33135 



PCTVUS98/01437 



-7- 

it can determine the age of a rating for an item. A rating which is very old may indicate that the 
rating is less valid than a rating entered recently, for example, users' tastes may change or "drift" 
over time. One of the fields of the n-tuple may represent whether the rating was entered by the 
user or inferred by the system. Ratings that are inferred by the system may be assumed to be less 
valid than ratings that are actually entered by the user. Other items of information may be stored, 
and any combination or subset of additional information may be used to assess rating validity. In 
some embodiments, this validity metric may be represented as a confidence factor, that is, the 
combined effect of the selected pieces of information recorded in the n-tuple may be quantified as 
a number. In some embodiments, that number may be expressed as a percentage representing the 
probability that the associated rating is incorrect or as an expected deviation of the predicted 
rating from the "correct" value. 

The user profiles are accessed in order to calculate a similarity factor for each user with 
respect to all other users (step 104). A similarity factor represents the degree of correlation 
between any two users with respect to a set of items. The calculation to be performed may be 
selected such that the more two users correlate, the closer the similarity factor is to zero. 
Specialized hardware may be provided for calculating the similarity factors between users, 
although it is preferred to provide a general-purpose computer with appropriate programming to 
calculate the similarity factors. 

Whenever a rating is received from a user or is inferred by the system from that user's 
behavior, the profile of that user may be updated as well as the profile of the item rated. Profile 
updates may be stored in a temporary memory location and entered at a convenient time or 
profiles may be updated whenever a new rating is entered by or inferred for that user. Profiles 
can be updated by appending a new n-tuple of values to the set of already existing n-tuples in the 
profile or, if the new rating is a change to an existing rating, overwriting the appropriate entry in 
the user profile. Updating a profile also requires re-computation of any profile entries that are 
based on other information in the profile. 

Whenever a user's profile is updated with new rating-item n-tuple, new similarity factors 
between the user and other users of this system may be calculated. The similarity factor for a user 
may be calculated by comparing that user's profile with the profile of every other user of the 
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system. This is computationally intensive, since the order of computation for calculating similarity 
factors in this manner is n 2 . where n is the number of users of the system. It is possible to reduce 
the computational load associated with re-calculating similarity factors in embodiments that store 
item profiles by first retrieving the profiles of the newly-rated item and determining which other 
5 users have already rated that item. The similarity factors between the newly-rating user and the 
users that have already rated the item are the only similarity factors updated. 

Any number of methods can be used to calculate the similarity factors. In general, a 
method for calculating similarity factors between users should minimize the deviation between a 
predicted rating for an item and the rating a user would actually have given the item. 

10 It is also desirable to reduce error in cases involving "extreme" ratings. That is, a method 

which predicts fairly well for item ratings representing ambivalence towards an item but which 
does poorly for item ratings representing extreme enjoyment or extreme disappointment with an 
item is not useful for recommending items to users. 

Similarity factors between users refers to any quantity which expresses the degree of 
correlation between two user's profiles for a particular set of items. The following methods for 
calculating the similarity factor are intended to be exemplary, and in no way exhaustive. 
Depending on the item domain, different methods will produce optimal results, since users in 
different domains may have different expectations for rating accuracy or speed of 
recommendations. Different methods may be used in a single domain, and, in some embodiments, 
the system allows users to select the method by which they want their similarity factors produced. 

In the following description of methods, Dxy represents the similarity factor calculated 
between two users, x and y. represents the rating given to item i by user x, I represents all 
items in the database, and c* is a Boolean quantity which is i if user x has rated item i and 0 if 
user x has not rated that item. 

25 One method of calculating the similarity between a pair of users is to calculate the average 

squared difference between their ratings for mutually rated items. Thus, the similarity factor 
between user x and user y is calculated by subtracting, for each item rated by both users, the 
rating given to an item by user y from the rating given to that same item by user x and squaring 
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the difference. The squared differences are summed and divided by the total number of items 
rated. This method is represented mathematically by the following expression: 

D - m 



xy 



A similar method of calculating the similarity factor between a pair of users is to divide the 
5 sum of their squared rating differences by the number of items rated by both users raised to a 
power. This method is represented by the following mathematical expression: 



Z) = 



_ i€Cxy 



39 \r \ k 

where |Cxy| represents the number of items rated by both users. 

A third method for calculating the similarity factor between users attempts to factor into 
10 the calculation the degree of profile overlap, i.e. the number of items rated by both users 

compared to the total number of items rated by either one user or the other. Thus, for each item 
rated by both users, the rating given to an item by user y is subtracted from the rating given to 
that same item by user x. These differences are squared and then summed. The amount of profile 
overlap is taken into account by dividing the sum of squared rating differences by a quantity equal 
15 to the number of items mutually rated by the users subtracted from the sum of the number of 
items rated by user x and the number of items rated by users y. This method is expressed 
mathematically by: 

D 



id itU 

where |Cxy| represents the number of items mutually rated by users x and y. 

20 In another embodiment, the similarity factor between two users is a Pearson r correlation 

coefficient. Alternatively, the similarity factor may be calculated by constraining the correlation 
coefficient with a predetermined average rating value, A. Using the constrained method, the 
correlation coefficient, which represents Dxy, is arrived at in the following manner. For each item 
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rated by both users, A is subtracted from the rating given to the item by user x and the rating 
given to that same item by user y. Those differences are then multiplied. The summed product of 
rating differences is divided by the product of two sums. The first sum is the sum of the squared 
differences of the predefined average rating value, A, and the rating given to each item by user x. 
The second sum is the sum of the squared differences of the predefined average value, A, and the 
rating given to each item by user y. This method is expressed mathematically by: 

Dxy = Zik-Afz^-Af 

where U x represents all items rated by x, U y represents all items rated by y, and C xy represents all 
items rated by both x and y. 

The additional information included in a n-tuple may also be used when calculating the 
similarity factor between two users. For example, the information may be considered separately 
in order to distinguish between users, e.g. if a user tends to rate items only at night and another 
user tends to rate items only during the day, the users may be considered dissimilar to some 
degree, regardless of the fact that they may have rated an identical set of items identically. 
Alternatively, if the additional information is being used as a confidence factor as described above, 
then the information may be used in at least two ways. 

In one embodiment, only item ratings that have a confidence factor above a certain 
threshold are used in the methods described above to calculate similarity factors between users. 

In a second embodiment, the respective confidence factors associated with ratings in each 
user's profile may be factored into each rating comparison. For example, if a first user has given 
an item a rating of "7" which has a high confidence factor, but a second user has given the same 
item a rating of "7" with a low confidence factor, the second user's rating may be "discounted." 
For example, the system may consider the second user as having a rating of "4" for the item 
instead of "7." Once ratings are appropriately "discounted", similarity factors can be calculated 
using any of the methods described above. 
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Regardless of the method used to generate them, or whether the additional information 
contained in the profiles is used, the similarity factors are used to select a plurality of users that 
have a high degree of correlation to a user (step 106). These users are called the user's 
"neighboring users." A user may be selected as a neighboring user if that user's similarity factor 

5 with respect to the requesting user is better than a predetermined threshold value, L. The 

threshold value, L, can be set to any value which improves the predictive capability of the method. 
In general, the value of L will change depending on the method used to calculate the similarity 
factors, the item domain, and the size of the number of ratings that have been entered. In another 
embodiment, a predetermined number of users are selected from the users having a similarity 

10 factor better than L, e.g. the top twenty-five users. For embodiments in which confidence factors 
are calculated for each user-user similarity factor, the neighboring users can be selected based on 
having both a threshold value less than L and a confidence factor higher than a second 
predetermined threshold. 

In some embodiments, users are placed in the rating user's neighbor set based on 
considerations other than the similarity factor between the rating user and the user to be added to 
the set. For example, the additional information associated with item ratings may indicate that . 
whenever user A has rated an item highly, User B has sampled that item and also liked it 
considerably. The system may assume that User B enjoys following the advice of User A. 
However, User A may not be selected for User B's neighbor set using the methods described 
above due to a number of reasons, including that there may be a number of users in excess of the 
threshold, L, which highly correlate with User B's profile. These highly correlated users will fill 
up User B's neighbor set regardless of their use in recommending new items to User B. 

Alternatively, certain users may not be included in a neighbor set because their 
contribution is cumulative. For example, if a user's neighbor set already includes two users that 
25 have rated every Dim Sum restaurant in Boston, a third user that has rated only Dim Sum 

restaurants in Boston would be cumulative, regardless of the similarity factor calculated for that 
user, and another user who has rated different items in a different domain may be included 
instead. 
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Another embodiment in which neighbors may be chosen for a user based on the additional 
information stored in the user profiles concerns multi-domain settings. In these settings, a user 
may desire to explore a new domain of items. However, the user's neighbors may not have 
explored that domain sufficiently to provide the user with adequate recommendations for items to 
5 sample. In this situation, users may be selected for the exploring user's neighbor set based on 
various factors, such as the number of items they have rated in the domain which the user wants 
to explore. This may be done on the assumption that a user that has rated many items in a 
particular domain is an experienced guide to that domain. 

A user's neighboring user set should be updated each time that a new rating is entered by, 
10 or inferred for, that user. In many applications it is desirable to reduce the amount of 

computation required to maintain the appropriate set of neighboring users by limiting the number 
of user profiles consulted to create the set of neighboring users. In one embodiment, instead of 
updating the similarity factors between a rating user and every other user of the system (which has 
computational order of n 2 ), only the similarity factors between the rating user and the rating user's 
15 neighbors, as well as the similarity factors between the rating user and the neighbors of the rating 
user's neighbors are updated. This limits the number of user profiles which must be compared to 
m minus any degree of user overlap between the neighbor sets where m is a number smaller than 
n. In this embodiment, similar users are selected in any manner as described above, such as a 
similarity factor threshold, a combined similarity factor-confidence factor threshold, or solely on 
20 the basis of additional information contained in user profiles. 

Once a set of neighboring users is chosen, a weight is assigned to each of the neighboring 
users (step 108). In one embodiment, the weights are assigned by subtracting the similarity factor 
calculated for each neighboring user from the threshold value and dividing by the threshold value. 
This provides a user weight that is higher, i.e. closer to one, when the similarity factor between 
25 two users is smaller. Thus, similar users are weighted more heavily than other, less similar, users. 
In other embodiments, the confidence factor can be used as the weight for the neighboring users. 
Users that are placed into a neighbor set on the basis of other information, i.e. "reputation" or 
experience in a particular domain, may have an appropriate weight selected for them. For 
example, if a user is selected because of their experience with a particular domain, that user may 
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be weighted very highly since it is assumed that they have much experience with the items to be 
recommended. The weights assigned to such users may be adjusted accordingly to enhance the 
recommendations given to the user. 

Once weights are assigned to the neighboring users, an item is recommended to a user 
5 (step 1 10). For applications in which positive item recommendations are desired, items are 
recommended if the user's neighboring users have also rated the item highly. For an application 
desiring to warn users away from items, items are displayed as recommended against when the 
user's neighboring users have also given poor ratings to the item. Once again, although 
specialized hardware may be provided to select and weight neighboring users, an appropriately 
10 programmed general-purpose computer may provide these functions. 

The item to be recommended may be selected in any fashion, so long as the ratings of the 
neighboring users, their assigned weights, and the confidence factors, if any, are taken into 
account. In one embodiment, a rating is predicted for each item that has not yet been rated by the 
user. This predicted rating can be arrived at by taking a weighted average of the ratings given to 
1 5 those items by the user' s neighboring users. A predetermined number of items may then be 
recommended to the user based on the predicted ratings. 

Recommendations may also be generated using the additional information associated with 
the user ratings or the confidence factors associated with the similarity factors calculated between 
a user and the user's neighbors. For example, the additional information may be used to discount 
20 the rating given to items. In this embodiment, the additional information may indicate that a 
rating is possibly invalid or old would result in that rating being weighted less than other ratings. 
The additional information may be expressed as a confidence factor and, in this embodiment, 
items are recommended only if the user's neighboring user both recommends them highly and 
there is a high confidence factor associated with that user's rating of the item. 

25 The predetermined number of items to recommend can be selected such that those items 

having the highest predicted rating are recommended to the user or the predetermined number of 
items may be selected based on having the lowest predicted rating of all the items. Alternatively, if 
a system has a large number of items from which to select items to recommend, confidence 
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factors can be used to limit the amount of computation required by the system to generate 
recommendation. For example, the system can select the first predetermined number of items that 
are highly rated by the user's neighbors for which the confidence factor is above a certain 
threshold. 

Recommendations can take any of a number of forms. For example, recommended items 
may be output as a list, either printed on paper by a printer, visually displayed on a display screen, 
or read aloud. 

In another embodiment the user selects an item for which a predicted rating is desired. A 
rating can be predicted by taking a weighted average of the ratings given to that item by the user's 
neighboring users. 

Whatever method is used, information about the recommended items can be displayed to 
the user. For example, in a music domain, the system may display a list of recommended albums 
including the name of the recording artist, the name of the album, the record label which made the 
album, the producer of the album, "hit" songs on the album, and other information. In the 
embodiment in which the user selects an item and a rating is predicted for that item, the system 
may display the actual rating predicted, or a label representing the predicted rating. For example, 
instead of displaying 6.8 out of a possible 7.0 for the predicted rating, a system may instead 
display "highly recommended". Embodiments in which a confidence factor is calculated for each 
prediction may display that information to the user, either as a number or a label. For example, 
the system may display "highly recommended - 85% confidence" or it may display "highly 
recommended - very sure." 

In one embodiment, items are grouped in order to help predict ratings and increase 
recommendation certainty. For example, in the broad domain of music, recordings may be 
grouped according to various genres, such as "opera " "pop," "rock," and others. Groups are 
used to improve performance because predictions and recommendations for a particular item are 
made based only on the ratings given to other items within the same group. Groups may be 
determined based on information entered by the users, however it is currently preferred to 
generate the groups using the item data itself. 
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Generating the groups using the item data itself can be done in any manner which groups 
items together based on some differentiating feature. For example, in the item domain of music 
recordings, groups could be generated corresponding to "pop," "opera," and others. 

In the preferred embodiment, item groups are generated by, first, randomly assigning all 
items in the database to a number of groups. The number of desired groups can be predetermined 
or random. For each initial group, the centroid of the ratings for items assigned to that group are 
calculated. This can be done by any method that determines the approximate mean value of the 
spectrum of ratings contained in the item profiles assigned to the initial group, such as 
eigenanalysis. It is currently preferred is to average all values present in the initial group. 

After calculating the group centroids, determine to which group centroid each item is 
closest, and move it to that group. Whenever an item is moved in this manner, recalculate the 
centroids for the affected groups. Iterate until the distance between all group centroids and items 
assigned to each group are below a predetermined threshold or until a certain number of iterations 
have been accomplished. 

A method using grouping to improve performance calculates similarity factors for a user 
with respect to other users for a particular group (step 104). For example, a user may have one 
similarity factor with respect to a second user for the "pop" grouping of music items and a second 
similarity factor with respect to that same user for the "opera" grouping of music items. This is 
because the "pop" similarity factor is calculated using only ratings for "pop" items, while the 
"opera" similarity factor is calculated only for "opera" items. Any of the methods described 
above for calculating similarity factors may be used. 

The neighboring users are selected based on the similarity factors (step 106). The 
neighboring users are weighted, and recommendations for items are arrived at 
(steps 108 and 1 1 0) as above. A weighted average of the ratings given to other items in the 
group can be used to recommend items both inside the group and outside the group. For 
example, if a user has a high correlation with another user in the "pop" grouping of music items, 
that similarity factor can be used to recommend music items inside the "pop" grouping, since both 
users have rated many items in the group. The similarity factor can also be used to recommend a 
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music item outside of the group, if one of the users has rated an item in another group. 
Alternatively, a user may select a group, and a recommendation list will be generated based on the 
predicted rating for the user's neighboring users in that group. 

Whether or not grouping is used, a user or set or users may be recommended to a user as 
5 having similar taste in items of a certain group. In this case, the similarity factors calculated from 
the user profiles and item profiles are used to match similar users and introduce them to each 
other. This is done by recommending one user to another in much the same way that an item is 
recommended to a user. It is possible to increase the recommendation certainty by including the 
number of items rated by both users in addition to the similarity factors calculated for the users. 

10 The user profiles and, if provided, item profiles may be used to allow communication to be 

targeted to specific users that will be most receptive to the communication. This may be done in 
at least two ways. 

In a first embodiment, a communication is provided which is intended to be delivered to 
users that have rated a particular item or set of items highly. In this embodiment, if the 
15 communication is to be targeted at users that have rated a particular item highly, then the profile 
for that item is retrieved from memory and users which have rated the item highly are determined. 
The determination of users that have rated the item highly may be done in any number of ways, 
for example, a threshold value may be set and users which have given a rating for the item in 
excess of that threshold value would be selected as targeted users. 

20 Alternatively, if the communication is to be targeted at users that have rated a set of items 

highly, then each profile for each item that is to be considered can be retrieved from the memory 
element and a composite rating of items may be produced for each user. The composite rating 
may be a weighted average of the individual ratings given to the items by a user; each item may be 
weighted equally with all the other items or a predetermined weight may be assigned to each 

25 individual item. In this embodiment, once a composite rating for each user has been determined, 
then targeted users are selected. This selection may be done by setting a predetermined threshold 
which, when a user's composite rating is in excess of, indicates that user is a targeted user. 
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In either embodiment, once targeted users are selected, the communication is displayed on 
that user's screen whenever the user accesses the system. In other embodiments the 
communication may be a facsimile message, an electronic mail message, or an audio message. 

In a second embodiment, the communication which is to be targeted to selected users may 
5 seek out its own receptive users based on information stored in the user profiles and ratings given 
to the communication by users of the system. In this embodiment, the communication initially 
selects a set of users to which it presents itself. The initial selection of users may be done 
randomly, or the communication may be "preseeded" with a user profile which is its initial target. 

Once a communication presents itself to a user or set of users, it requests a rating from 
10 that user or users. Users may then assign a rating to the communication in any of the ways 
described above. Once a communication receives a rating or ratings from users, the 
communication determines a new set of users to which it presents itself based on the received 
rating. One way the communication does this is to choose the neighbors of users that have rated 
it highly. In another embodiment, the communication analyzes the ratings it has received to 
15 determine the ideal user profile for a hypothetical user in the second set of users to which it will 
present itself. The communication does this by retrieving from memory the user profiles of each 
user that has given it a rating. The communication then analyzes those user profiles to determine 
characteristics associated with users that have given it a favorable rating. 

The communication may assume that it can infer more from looking at items that users 
20 have rated favorably or it may instead attempt to gather information based on items that those 
users have rated unfavorably. Alternatively, some selection of items in a group may be used to 
determine characteristics of favorable user profiles. In this embodiment, the communication may 
perform a similarity factor calculation using any of the methods described above. The set of 
neighboring users is the set of users to which the communication will present itself. 

25 Once the communication has presented itself to the second set of users, the series of steps 

repeats with the new users rating the communication and the communication using that 
information to further refine its ideal user to which it will present itself. In some embodiments, a 
limit may be placed the number of users to which a communication may present itself in the form 
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of tokens which the communication spends to present itself to a user, perform a similarity factor 
calculation, or other activities on the system. For example, a communication may begin with a 
certain number of tokens. For each user that it presents itself to, the communication must spend a 
token. The communication may be rewarded for users who rate it highly by receiving more 
tokens from the system than it had to pay to present itself to that user. Also, a communication 
may be penalized for presenting itself to users who give it a low rating. This penalty may take the 
form of a required payment of additional tokens or the communication may simply not receive 
tokens for the poor rating given to it by the user. Once the communication is out of tokens, it is 
no longer active on the system. 

Grouping, as described above, is a special case of "feature-guided automated collaborative 
filtering" when there is only one feature of interest. The method of the present invention works 
equally well for item domains in which the items have multiple features of interest, such as World 
Wide Web pages. 

The method using feature-guided automated collaborative filtering incorporates feature 
values associated with items in the domain. The term "feature value" is used to describe any 
information stored about a particular feature of the item. For example, a feature value may have 
boolean feature values indicating whether or not a particular feature exists or does not exist in a 
particular item. 

Alternatively, features may have numerous values, such as terms appearing as "keywords" 
in a document. In some embodiments, each feature value can be represented by a vector in some 
metric space, where each term of the vector corresponds to the mean score given by a user to 
items having the feature value. 

Ideally, it is desirable to calculate a vector of distances between every pair of users, one 
for each possible feature value defined for an item. This may not be possible if the number of 
possible feature values is very large, i.e., keywords in a document, or the distribution of feature 
values is extremely sparse. Thus, in many applications, it is desirable to cluster feature values. 
The terms "cluster" and "feature value cluster" are used to indicate both individual feature values 
as well as feature value clusters, even though feature values may not necessarily be clustered. 
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Feature value clusters are created by defining a distance function A, defined for any two 
points in the vector space, as well as vector combination function Q which combines any two 
vectors in the space to produce a third point in the space that in some way represents the average 
of the points. Although not limited to the examples presented, three possible formulations of A 
5 and CI are presented below. 

The notion of similarity between any two feature values is how similarly they have been 
rated by the same user, across the whole spectrum of users and items. One method of defining 
the similarity between any two feature values is to take a simple average. Thus, we define the 

value to be the mean of the rating given to each item containing feature value FV" that user 

10 i has rated. Expressed mathematically: 



may be used to determine the per-user dimension squared distance between vectors feature value 
a x and feature value a y for user i. For example, any of the methods referred to above for 
15 calculating user similarity may be used. 

Defining 5 as the per-user dimension squared distance between two feature values, the 
total distance between the two feature value vectors is expressed mathematically as: 




otherwise 




X 

Where 1^ indicates the presence or absence of feature value FV" in item p. Any distance metric 



A(FV a x ,FV a y )= (• 




where, the term 
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represents adjustment for missing data. 



The combination function for the two vectors, which represents a kind of average for the 
two vectors, is expressed mathematically by the following three equations. 



v i x+ v i i/rjy = l and 77^=1 

2 

~* a * if Vy^l rj a y-0 

//t/** = 0 and 77^= 1 



wherein 77** indicates whether y" M is defined. 

Another method for calculating the similarity between any two feature values is to assume 

the number of values used to compute y a } * is sufficiently large. If this assumption is made, the 

Central Limit Theorem can be used to justify approximating the distribution of vectors by a 
10 Gaussian distribution. 

Since the Gaussian distribution can be effectively characterized by its mean, variance and 
sample size, each entry y a } * is now a triplet. 

V, •[M r ' 1 ." 1 ) 

where 

is the sample mean of the population, 
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_2«- _ 



is the variance of the sampling distribution, and 



\ltems\ 



is the sample size. 



The total distance between the two feature value vectors is expressed 
mathematically by: 



A(Fr; 9 Fr;) = 



pser4 



Zpsersj 
/=1 *li X7 7z 



r \\User4 > 



The feature value combination function combines the corresponding triplets from 
the two vectors by treating them as gaussians, and therefore is represented mathematically by: 



< , a 2 "'-*' , Nj'' > if 77,"" = 1 and rj? = 1 
< Mi' , o- 2 °* , > if Tfi* = 1 and = 0 

< fi°> , a 2 °" , N" f > if rj? = 0 and tj? = 1 



where 



Mi"' = 



represents the mean of the new population, 



a2 «„ (n;> +(n;> X* 2 "/) | ( N ? +N ;>) -tf) 2 



■) 
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represents the variance of the combined population, and 



represents the sample size of the combined population. 

The third method of calculating feature value similarity metrics attempts to take into 
account the variance of the sampling distribution when the sample size of the population is small. 
A more accurate estimator of the population variance is given by the term 



.. l!T((«,,-K-K *r;- ) 



ST = 



(2£V*?))- 



1 



and represents the sample variance, which is an accurate estimator of the underlying 
population variance. 

Accordingly operator tj"* is redefined as: 



1 if 



d , C T IT**) > 1 

I,p p ' 



0 Otherwise 



and the triplet is defined as: 



v 7 °' = <tf>,S 2 i',N?- > 
Given the above, the sample variance is represented as: 



O J — — ™" — ■ 



The sample variance and the variance of the sample distribution for a finite population are 
related by the following relationship: 



WO 98/33135 



PCT/US98/01437 



-23- 



N 



which transforms the standard deviation into: 



f \ 
N? x - 1 

l(^) 2 J 



x5T + 



( \ 

N°> - 1 



Thus, the feature value vector combination function is defined as: 



Q(FV x a 9 F?;) = 



<V a r\S ia r\N*>"' > if ft = 1 and tj*' = 1 
< /i;- ,S 2 1 1 , AT/' > if 77?' = 1 and tj°> = 0 
<Ph\S 2 ?\N a / > if ^ = 0 and 77^ - 1 



Regardless of the feature value combination function used, the item similarity metrics 
generated by them are used to generate feature value clusters. Feature value clusters are 
generated from the item similarity metrics using any clustering algorithm known in the art. For 
example, the method described above with respect to grouping items could be used to group 
10 values within each feature. 

Feature values can be clustered both periodically and incrementally. Incremental 
clustering is necessary when the number of feature values for items is so large that reclustering of 
all feature values cannot be done conveniently. However, incremental clustering may be used for 
any set of items, and it is preferred to use both periodic reclustering and incremental reclustering. 

15 All feature values are periodically reclustered using any clustering method known in the 

art, such as K-means. It is preferred that this is done infrequently, because of the time that may 
be required to complete such a reclustering. In order to cluster new feature values present in 
items new to the domain, feature values are incrementally clustered. New feature values present 
in the new items are clustered into the already existing feature value clusters. These feature 

20 values may or may not be reclustered into another feature value cluster when the next complete 
reclustering is done. 
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Using the feature value clusters generated by any one of the methods described above, a 
method for recommending an item, as shown in FIG. 2, uses feature clusters to aid in predicting 
ratings and proceeds as the method of FIG. 1, in that a plurality of user profiles is stored 
(step 102*). As above, a plurality of item profiles may also be stored. The method using feature 
value clusters assigns a weight to each feature value cluster and a weight to each feature based on 
the users rating of the item (steps 120 and 122). 

A feature value cluster weight for each cluster is calculated for each user based on the 
user's ratings of items containing that cluster. The cluster weight is an indication of how 
important a particular user seems to find a particular feature value cluster. For example, a feature 
for an item in a music domain might be the identity of the producer. If a user rated highly all 
items having a particular producer (or cluster of producers), then the user appears to place great 
emphasis on that particular producer (feature value) or cluster of producers (feature value 
cluster). 

Any method of assigning feature value cluster weight that takes into account the user's 
rating of the item and the existence of the feature value cluster for that item is sufficient, however, 
it is currently preferred to assign feature value cluster weights by summing all of the item ratings 
that a user has entered and dividing by the number of feature value clusters. Expressed 
mathematically, the vector weight for cluster x of feature a for user I is: 



where is a boolean operator indicating whether item p contains the feature value cluster x of 
feature a. 

The feature value cluster weight is used, in turn, to define a feature weight. The feature 
weight reflects the importance of that feature relative to the other features for a particular feature. 
Any method of estimating a feature weight can be used; for example, feature weights may be 
defined as the reciprocal of the number of features defined for all items. It is preferred that 




0.0 



otherwise 
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feature weights are defined as the standard deviation of all cluster weight divided by the means of 
all cluster weights. Expressed mathematically: 

( 

StandardDev \CWi 
FW a j = ^ J 

The feature value cluster weights and the feature weights are used to calculate the 
similarity factor between two users. The similarity factor between two users may be calculated by 
any method that takes into account the assigned weights. For example, any of the methods for 
calculating the similarity between two users, as described above, may be used provided they are 
augmented by the feature weights and feature value weights. Thus 



\FeaturesDeJined\ ^ a f \a\ \ 



represents the similarity between users I and J, where r ** [p I 7 ) is a boolean operator on a 

vector of values indicating whether feature value cluster of x for feature a of the vector is defined 
and where 



0.0 otherwise 



The representation of an item as a set of feature values allows the application of various 
feature-based similarity metrics between items. Two items may not share any identical feature 
values but still be considered quite similar to each other if they share some feature value clusters. 
This allows the recommendation of unrated items to a user based on the unrated items similarity 
to other items which the user has already rated highly. 



The similarity between two items pi and p 2 , where Pi and P 2 represent the corresponding 
sets of feature values possessed by these items, can be represented as some function, f, of the 
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following three sets: the number of common feature values shared by the two items; the number 
of feature values that pi possesses that P2 does not; and the number of feature values that p 2 
possesses that pi does not 

Thus, the similarity between two items, denoted by S(pi, P2), is represented as: 

5 S( Pv p 2 ) = F{P i f]P 2 ,P ] -P 2 ,P 2 -Pd 

Each item is treated as a vector of feature value clusters and the item-item similarity 
metrics are defined as: 

^Features Defined] |a | 

/(^np 2 )= Z fw; x ^(cw,* x r ; ; xr ;«) 

a=l a^l 

10 

\\Features Defined | ||a| 

/ft-A)= Z Fw;xZcwr»x r ;;x(i- r ^)) 

\Features Defined] [a| 

/(^Wi) = Z FW;x2(cWT"x(l-y-')x y 5) 

15 This metric is personalized to each user since the feature weights and cluster weights 

reflect the relative importance of a particular feature value to a user. 

Another method of defining item-item similarity metrics attempts to take into account the 
case where one pair of items has numerous identical feature values, because if two items share a 
number of identical feature values, they are more similar to each other then two items that do not 
20 share feature values. Using this method, f(PmP 2 ) is defined as: 

\Features Defined | Jar] |FV*| 

/ft n P*) = Z x ( Z(CW°» x yl x Y £ ) + £ (i^ x r-< )) 

a=l a,=l 1=1 

Another method for calculating item-item similarity is to treat each item as a vector of 
feature value clusters and then compute the weighted dot product of the two vectors. Thus, 



S0>»p 7 ) = g(PinP 2 ) 
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where 

IFeaturesDefinedl \a\ 

In another aspect, the system and method may be used to identify users that will enjoy a 
particular item. In this aspect, as above, user profiles and item profiles are stored in a memory 
5 element, and the user profiles and item profiles record ratings given to items by users. An item 
profile contains at least an identification of a user and the rating given to that item by that user. 
The item profile may contain additional information just as described in connection with user 
profiles. Similarity factors between items are calculated using any of the methods described 
above. For example, using the squared difference method for calculating similarity factors, the 
10 rating given to a first item by User A and the rating given to a second item by User A are 

subtracted and that difference is squared. This is done for each user that has rated both items. 
The squared differences are then summed and divided by the total number of users that have rated 
both items. 

This provides an item-item similarity metric and a group of neighboring items is selected in 
15 the same way as described above. Those neighboring items are then weighted and a user, or 
group of users, that will be receptive to a given item are determined. Again, this may be done 
using any of the methods described above, including using confidence factors, item grouping, or 
feature guided automated collaborative filtering. 

The methods described above can be provided as software on any suitable medium that is 
20 readable by a computing device. The software programs means may be implemented in any 

suitable language such as, C, C++, PERL, LISP, ADA, assembly language or machine code. The 
suitable media may be any device capable of storing program means in a computer-readable 
fashion, such as a floppy disk, a hard disk, an optical disk, a CD-ROM, a magnetic tape, a 
memory card, or a removable magnetic drive. 

25 An apparatus may be provided to recommend items to a user. The apparatus, as shown in 

FIG, 3 has a memory element 12 for storing user and item profiles. Memory element 12 can be 
any memory element capable of storing the profiles such as, RAM, EPROM, or magnetic media. 



WO 98/33135 



PCT/US98/01437 



-28- 

A means 14 for calculating is provided which calculates the similarity factors between 
users. Calculating means 14 may be specialized hardware to do the calculation or, alternatively, 
calculating means 14 may be a microprocessor or software running on a microprocessor resident 
in a general-purpose computer. 

Means 16 for selecting is also provided to select neighboring users responsive to the 
similarity factors. Again, specialized hardware or a microprocessor may be provided to 
implement the selecting means 16, however preferred is to provide a software program running on 
a microprocessor resident in a general-purpose computer. Selecting means 16 may be a separate 
microprocessor from calculating means 14 or it may be the same microprocessor. 

A means 1 8 for assigning a weight to each of the neighboring users is provided and can be 
specialized hardware, a separate microprocessor, the same microprocessor as calculating means 
14 and selecting means 16, or a microprocessor resident in a general-purpose computer and 
running software. 

In some embodiments a receiving means is included in the apparatus (not shown in FIG. 
3). Receiving means is any device which receives ratings for items from users. The receiving 
means may be a keyboard or mouse connected to a personal computer. In some embodiments, an 
electronic mail system operating over a local are network or a wide area network forms the 
receiving means. In the preferred embodiment, a World Wide Web Page connected to the 
Internet forms the receiving means. 

Also included in the apparatus is means 20 for recommending at least one of the items to 
the users based on the weights assigned to the users, neighboring users and the ratings given to 
the item by the users' neighboring users. Recommendation means 20 may be specialized 
hardware, a microprocessor, or, as above, a microprocessor running software and resident on a 
general-purpose computer. Recommendation means 20 may also comprise an output device such 
as a display, audio output, or printed output. 

In another embodiment an apparatus for recommending an item is provided that uses 
feature weights and feature value weights. This apparatus is similar to the one described above 
except that it also includes a means for assigning a feature value cluster weight 22 and a means for 
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assigning a feature weight 24 (not shown in FIG. 3). Feature value cluster weight assigning 
means 22 and feature value weight assigning means 24 may be provided as specialized hardware, 
a separate microprocessor, the same microprocessor as the other means, or as a single 
microprocessor in a general purpose computer. 

5 FIG. 4 shows the Internet system on which an embodiment of the method and apparatus 

may be used. The server 40 is an apparatus as shown in FIG. 3, and it is preferred that server 40 
displays a World Wide Web Page when accessed by a user via Internet 42. Server 40 also accepts 
input over the Internet 42. Multiple users 44 may access server 40 simultaneously. In other 
embodiments, the system may be a stand-alone device, e.g. a kiosk, which a user physically 

10 approaches and with which the user interacts. Alternatively, the system may operate on an 
organization's internal web, commonly known as an Intranet, or it may operate via a wireless 
network, such as satellite broadcast. 

EXAMPLE 1 

The following example is one way of using the invention, which can be used to 
15 recommend items in various domains for many items. By way of example, a new user 44 accesses 
the system via the World Wide Web. The system displays a welcome page, which allows the user 
44 to create an alias to use when accessing the system. Once the user 44 has entered a personal 
alias, the user 44 is asked to rate a number of items, in this example the items to be rated are 
recording artists in the music domain. 

20 After the user 44 has submitted ratings for various recording artists, the system allows the 

user 44 to enter ratings for additional artists or to request recommendations. If the user 44 
desires to enter ratings for additional artists, the system can provide a list of artists the user 44 has 
not yet rated. For the example, the system can simply provide a random listing of artists not yet 
rated by the user 44. Alternatively, the user 44 can request to rate artists that are similar to 

25 recording artists they have already rated, and the system will provide a list of similar artists using 
the item similarity values previously calculated by the system. The user can also request to rate 
recording artists from a particular group, e.g. modern jazz, rock, or big band, and the system will 
provide the user 44 with a list of artists belonging to that group that the user 44 has not yet rated. 
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The user 44 can also request to rate more artists that the user's 44 neighboring users have rated, 
and the system will provide the user 44 with a list of artists by selecting artists rated by the user's 
44 neighboring users. 

The user 44 can request the system to make artist recommendations at any time, and the 
5 system allows the user 44 to tailor their request based on a number of different factors. Thus, the 
system can recommend artists from various groups that the user's 44 neighboring users have also 
rated highly. Similarly, the system can recommend a predetermined number of artists from a 
particular group that the user will enjoy, e.g. opera singers. Alternatively, the system may 
combine these approaches and recommend only opera singers that the user's neighboring users 
10 have rated highly. 

The system allows the user 44 to switch between rating items and receiving 
recommendations many times. The system also provides a messaging function, so that users 44 
may leave messages for other users that are not currently using the system. The system provides 
"chat rooms," which allow users 44 to engage in conversation with other users 44' that are 
currently accessing the system. These features are provided to allow users 44 to communicate 
with one another. The system facilitates user communication by informing a user 44 that another 
user 44' shares an interest in a particular recording artist. Also, the system may inform a user 44 
that another user 44 that shares an interest in a particular recording artists is currently accessing 
the system, the system will not only inform the user 44, but will encourage the user 44 to contact 
the other user 44' that shares the interest. The user 44 may leave the system by logging off of the 
Web Page. 

EXAMPLE 2 

In another example, the system is provided as a stand-alone kiosk which is used by 
shoppers in a retail establishment. The kiosk has an output device such as a display screen or 
25 printer, and possible an input device, such as a touch screen or keyboard. The kiosk has a 

memory element which allows it to store profiles for items and users. In come cases, the kiosk 
may be provided with a CD-ROM drive for allowing "preseeded" user and item profiles to be 
loaded into the kiosk. 



15 



20 
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In this example, a user may approach a kiosk to determine an item which is recommended 
for them. The user would input their alias from the system of EXAMPLE 1, and the kiosk could 
access the CD-ROM in order to load the user's profile into memory. The kiosk may also load 
similarity factors which have been calculated before hand or the kiosk may calculate the similarity 
5 factors now. The kiosk can then use any of the methods described above to create a list of 
recommended item which may be printed out for the user, displayed to the user on the display 
screen, or read aloud to the user through an audio device. 

The kiosk may also provide the user with directions for how to find recommended items in 
the retail establishment, or the kiosk may allow the user to purchase the item directly by 
1 0 interacting with the kiosk. 

Having described preferred embodiments of the invention, it will now become apparent to 
one of skill in the art that other embodiments incorporating the concepts may be used. It is felt, 
therefore, that these embodiments should not be limited to disclosed embodiments but rather 
should be limited only by the spirit and scope of the following claims. 
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CLAIMS 

What is claimed is: 



11. A method for recommending an item to one of a plurality of users, the item not yet rated 

2 by the user, the method comprising the steps of: 

3 (a) storing a user profile in a memory for each of a plurality of users, wherein the user 

4 profile includes a plurality of values, at least some of the plurality of values representing a rating 

5 given to one of a plurality of items by the user and others of some of the plurality of values 

6 representing additional information; 

7 (b) calculating for a user a plurality of similarity factors responsive to both the ratings 

8 given to items by that user and the additional information, each of the plurality of similarity 

9 factors representing the similarity between the user and another one of the plurality of users; 

10 (c) selecting for the user a plurality of neighboring users responsive to the similarity 

1 1 factors; 

12 (d) assigning a weight to each of the neighboring users; and 

13 (e) recommending at least one of the plurality of items to the user based on the weights 

14 assigned to the user's neighboring users and the ratings given to the item by the user's 

15 neighboring users. 

1 2. The method of claim 1 wherein step (a) further comprises: 

2 storing a user profile in a memory for each of a plurality of users, wherein the user profile 

3 includes a plurality of values, at least some of the plurality of values representing a rating given to 

4 one of a plurality of items by the user and others of some of the plurality of values representing 

5 information relating to the given ratings. 

1 3. The method of claim 1 wherein step (a) further comprises: 

2 storing a user profile in memory for each of a plurality of users, wherein the user profile 

3 includes a plurality of values, at least some of the plurality of values representing a rating given to 



WO 98/33135 



PCT/US98/01437 



-33- 



4 one of a plurality of items by the user and others of some of the plurality of values representing 

5 information about the user. 

1 4. The method of claim 1 wherein step (a) further comprises: 

2 (a-a) storing a user profile in a memory for each of a plurality of users, wherein the user 

3 profile includes a plurality of values, at least some of the plurality of values representing a rating 

4 given to one of a plurality of items by the user and others of some of the plurality of values 

5 representing additional information; and 

6 (a-b) creating a confidence factor for one of the given ratings responsive to the additional 

7 information. 

1 5. The method of claim 1 wherein step (c) further comprises: 

2 calculating for a user a plurality of similarity factors and a plurality of similarity confidence 

3 factors, each of the plurality of similarity factors representing the similarity between the user and 

4 another one of the plurality of users, and each of the similarity confidence factors representing 

5 possible imprecision in the associated similarity factor. 

1 6. The method of claim 1 wherein in step (c) further comprises: 

2 calculating for a user a plurality of similarity factors responsive to the ratings given to 

3 items by users and the additional information associated with the given ratings, each of the 

4 plurality of similarity factors representing the similarity between the user and another one of the 

5 plurality of users. 

1 7. The method of claim 1 wherein step (c) further comprises: 

2 (c-a) inferring a user's rating for one of the plurality of items based on the user's 

3 behavior; 

4 (c-b) updating the user's profile with the inferred rating; and 

5 (c-c) calculating for the user a plurality of similarity factors, each of the plurality of 

6 similarity factors representing the similarity between the user and another user. 

1 8. The method of claim 1 further comprising the step of storing an item profile in a memory 

2 for each of the plurality of items, wherein the item profile includes a plurality of values, at least 
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3 some of the plurality of values representing a rating given to the item by one of the plurality of 

4 users. 



1 9. The method of claim 8 wherein step (c) further comprises: 

2 (c-a) inferring a user's rating for one of the plurality of items based on the user's 

3 behavior; 

4 (c-b) retrieving the item profile; 

5 (c-c) determining, from the item's profile, other users having ratings for the item; and 

6 (c-d) calculating a similarity factor between the user and each of the plurality of other 

7 users that have also rated the item. 

1 1 0. The method of claim 1 wherein step (d) further comprises selecting for the user at least 

2 one neighboring user on the basis of the additional information. 

1 11. The method of claim 5 wherein step (d) further comprises selecting for the user a plurality 

2 of neighboring users from the plurality of other users responsive to the similarity factors and the 

3 similarity confidence factors. 

1 12. The method of claim 5 wherein step (e) further comprises: 

2 assigning a weight to each of the neighboring users, wherein the weight is the similarity 

3 confidence factor. 

1 13. The method of claim 1 wherein step (f) further comprises: 

2 (f-a) recommending at least one of the plurality of items to the user based on the weights 

3 assigned to the user's neighboring users and the ratings given to the item by the user's 

4 neighboring users; and 

5 (f-b) generating a recommendation confidence factor responsive to the additional 

6 information associated with the ratings given to the item. 

1 14. The method of claim 5 wherein step (f) further comprises: 

2 (f-a) recommending at least one of a plurality of items to the user based on the weights 

3 assigned to the user's neighboring users and the ratings given to the item by the user's 

4 neighboring users; and 
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5 (f-b) generating a recommendation confidence factor responsive to the similarity 

6 confidence factors. 

1 15. An apparatus for recommending an item to one of a plurality of users, the item not yet 

2 rated by the user, comprising: 

3 a memory element for storing user profiles, wherein each user profile includes a plurality 

4 of values, each of at least some of the plurality of values representing a rating given to one of a 

5 plurality of items by the user and others of some of the plurality of values representing additional 

6 information; 

7 means for calculating, for each of the plurality of users, a plurality of similarity factors, 

8 each of the plurality of similarity factors representing the similarity between each user and another 

9 one of the plurality of users; 

10 means for selecting, for each of the plurality of users, a plurality of neighboring users 

1 1 responsive to the similarity factors; 

12 means for assigning a weight to each of the neighboring users; and 

1 3 means for recommending at least one of the plurality of items to one of the plurality of 

14 users based on the weights assigned to the user's neighboring users and the ratings given to the 

15 unrated item by the user's neighboring users. 

1 16. The apparatus of claim 15 further comprising a memory element for storing items profiles, 

2 wherein each item profile includes a plurality of values, each of at least some of the plurality of 

3 values representing a rating given to the item by one of the plurality of users. 

1 17. The apparatus of claim 1 5 further comprising means for inferring for a user a rating for an 

2 item responsive to the user's behavior. 

1 18. The apparatus of claim 15 wherein said selection means is responsive to the additional 

2 information stored in user profiles. 

1 19. An article of manufacture having embodied thereon: 

2 computer readable program means for storing user profiles in a memory, wherein each 

3 user profile includes a plurality of values, each of at least some of the plurality of values 

4 representing a rating given to one of a plurality of items by the user and others of some of the 
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5 plurality of values representing additional information; 

6 computer readable program means for calculating, for each of the plurality of users, a 

7 plurality of similarity factors, each of the plurality of similarity factors representing the similarity 

8 between each user and another one of the plurality of users; 

9 computer readable program means for selecting, for each of the plurality of users, a 

10 plurality of neighboring users responsive to the similarity factors; 

1 1 computer readable program means for assigning a weight to each of the neighboring users; 

12 and 

13 computer readable program means for recommending at least one of the plurality of items 

14 to one of the plurality of users based on the weights assigned to the user's neighboring users and 

15 the ratings given to the unrated item by the user's neighboring users. 

1 20. The article of manufacture of claim 19 further comprising computer-readable program 

2 means for inferring item ratings for users responsible to the user's behavior. 

1 21 . The article of manufacture of claim 1 9 further comprising computer-readable program 

2 means for storing item profiles in a memory element, wherein each item profile includes a plurality 

3 of values, each of at least some of the plurality of values representing a rating given to the item by 

4 one of the plurality of users. 

1 22. In a system for recommending items to users of the system based on ratings given to items 

2 by a user's neighboring users, a method for maintaining an appropriate neighbor set for a user 

3 comprising the steps: 

4 (a) storing a user profile in a memory for each of a plurality of users; 

5 (b) calculating a first plurality of similarity factors between a user and each of the 

6 user' s neighboring users; 

7 (c) calculating a second plurality of similarity factors between the user and each 

8 neighbor of each of the user's neighbors; and 

9 (d) selecting for the user a new plurality of neighboring users responsive to the first 

10 and second plurality of similarity factors. 



WO 98/33135 



PCT/US98/01437 



-37- 

1 23. The method of claim 22 further comprising, before step (b), the step of determining that a 

2 user's set of neighboring users must be updated whenever a rating is added to the user's profile. 

1 24. The method of claim 22 wherein step (a) further comprises storing a user profile in 

2 memory for each of a plurality of users, some of the values representing ratings given to items by 

3 the user and others of the values representing additional information related to the ratings. 

1 25. The method of claim 24 wherein step (b) further comprises calculating a first plurality of 

2 similarity factors between a user and each of the user's neighboring users, said calculation 

3 responsive to both the ratings given to the items by the users and the information related to the 

4 ratings. 

1 26. The method of claim 24 wherein step (c) further comprises calculating a second plurality 

2 of similarity factors between the user and each neighbor of each of the user's neighbors, said 

3 calculation responsive to both the ratings given to the items by the users and the additional 

4 information related to the ratings. 

1 27. The method of claim 24 wherein step (d) further comprises selecting a new plurality of 

2 neighboring users, at least one of said users selected based solely on the additional information 

3 related to the ratings contained in the at least one said users' profile and the rest of said users 

4 selected responsive to the first and second plurality of similarity factors. 

1 28. The method of claim 24 wherein step (a) further comprises storing a user profile in 

2 memory for each of a plurality of users, some of the values representing ratings given to items by 

3 the user and others of the values representing a confidence factor associated with the rating. 

1 29. A method for recommending an item to one of a plurality of users, the item not yet rated 

2 by the user, the method comprising the steps of: 

3 (a) storing a user profile in a memory for each of a plurality of users, wherein the user 

4 profile includes a plurality of values, some of the plurality of values representing the rating given 

5 to an item by the user and others of the plurality of values representing information relating to the 

6 rating; 

7 (b) calculating for the user a plurality of similarity factors between the user and the 
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user's neighboring users, said calculation responsive to both the ratings given to the items by that 
user and the information relating to the ratings; 

(c) calculating for the user a plurality of similarity factors between the user and the 
neighbors of the user's neighbors, said calculation responsive to both the ratings given to the 
items by those users and the information relating to the ratings; 

(d) selecting, for the user a second plurality of neighboring users responsive to the 
similarity factors; 

(e) assigning a weight to each of the neighboring users; and 

(f) recommending an item to the user based on the weights assigned to the 
neighboring users and the ratings given to the item by the neighboring users. 

30. The method of claim 29 wherein step (d) comprises: 

(d-a) selecting for the user a neighboring user based on the additional information 
contained in that user's profile; and 

(d-b) selecting for the user a plurality of neighboring users responsive to the generated 
similarity factors. 

3 1 . The method of claim 29 wherein step (f) comprises recommending an item to the user 
based on the information relating to the rating given to that item by one of the user's neighboring 
users. 
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